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ABSTRACT 


This  study  ii  concerned  With  the  optimisation  Of  multivariable  sampled- 
data  control  systems.  A  Squared  error  performance  criterion  is  chosen  and  the 
effects  of  controllability  and  observability  are  Studied.  In  particular  it  is  shown 
that  the  optimization  can  always  be  carried  out  on  a  system  all  of  whose  coordinates 
are  both  controllable  and  observable*  In  each  case  several  illustrative  examples 
are  included* 
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SECTION  I 
INTRODUCTION 


The  purpose  os  this  study  Is  to  consider  a  problem  of  optimization 
Using  the  point  of  view  developed  by  Gilbert  [l  ]  about  the  analysis  of  a  multi- 
variable  system,  in  particular  the  notion  of  controllability  and  observability 
introduced  by  Kalman  [2]  ,  modified  somewhat  by  Gilbert  [1  ]  will  be  recalled  in 
order  to  determine  in  which  way  the  optimization  problem  is  affected  when  some 
Of  the  coordinates  are  uncontrollable  or  unobservable. 

A  sampled  -  data  system  will  be  considered.  Section  II  contains  the 
basic  elements  of  Gilbert's  analysis  of  a  multivariable  system  adapted  to  the 
case  of  a  sampled  -  data.  Section  III  recalls  briefly  the  theory  of  dynamic  pro¬ 
gramming  which  is  used  in  the  following  sections. 

Section  IV  considers  a  problem  of  optimization  using  a  quadratic 
error  criterion  with  given  desired  final  value.  Section  V  treats  the  regulator 
problem  where  the  output  is  desired  to  follow  a  given  reference  input. 

It  will  be  shown  that  the  number  of  initial  conditions  that  has  to  be 
stated  is  equal  to  the  number  of  Observable  coordinates.  The  reference  input 
has  to  be  stated  a  priori  i.e.,  must  be  known  when  the  process  starts.  Finally 
the  optimization  can  be  limited  to  the  part  of  the  System  whose  coordinates  are 
both  controllable  and  observable. 


2 


SECTION  n 

ANALYSIS  OF  A  MULTIVARIABLE  SAMPLED- DATA  SYSTEM 

2.1  Introduction: 

A  multivariable  aampled-data  system  can  bo  represented  by 

x(k+l)  =  A  x(k)  +  Bu  (k)  (2-1) 

v(k)  =  C  x(k)  +  Du  (k)  (2-2) 


where  u(k)  is  a  p  dimensional  Input  vector  at 
the  Sampling  instant  k 

v  (k)  is  a  q  dimensional  output  vector  at  the 
Sampling  instant  k. 


GENERAL  REPRESENTATION 


x  (k)  is  a  n  dimensional  state-vector  at  the  instant  k.  This  vector  is  characteristic  o£ 
the  state  of  the  system  at  any  sampling  instant,  n  is  called  the  order  of  the  system. 

A  is  an  nth  order  square  matrix 

B  is  an  n  rows,  p  columns  matrix 

C  is  a  q  row,  n  column  matrix 

D  is  a  q  row,  p  column  matrix 

The  signal  flow-graph  of  this  representation  is  given  in  figure  2-2. 
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With  this  representation  the  state  of  the  system  is  known  only  at  the  Sampling  instants* 
its  behaviour  between  those  instants  is  not  known,  in  particular,  when  a  problem  of 
optimization  will  be  considered  on  Such  a  system,  determining  an  optimum  input  will  be 
Interpreted  as  "determining  the  values  of  this  input  at  the  sampling  instants". 

2-2.  NORMAL  REPRESENTATION  OF  A  SYSTEM  Tl]  ,  £  3  ] 

The  eigenvalues  of  matrix  A  are  assumed  to  be  distinct.  These  eigenvalues  are 
the  solutions  of  the  nth  order  equation 

det  [A  -  X  Ij  =  0  (2-3) 


1 


where  1  =» 


0 


Is  the  identity  matrix 


If  X4  is  one  particular  eigenvalue  the  vector  given  by  the  matrix  equation 

[A  *  \  1]  Vj  *  0  (2-4) 

is  called  the  eigenvector  corresponding  to  the  particular  eigenvalue  X^  . 

If  the  X^  are  distinct,  to  each  of  them  corresponds  one  and  only  one  eigenvector. 
Thus,  there  are  n  different  eigenvectors. 

a 

Consider  now  the  matrix  p  whose  column  vectors  are  the  n  eigenvectors, 

V  ^2 «  •••  Vr.  It  is  possible  to  show  that  the  matrix 

A  =  p  1  Ap  (2-5) 

is  a  diagonal  matrix  given  by 

onal  vector 


Given  a  n  rows  matrix  A  =  a 
whose  components  are  the  co. 


, .  the  jth  column  vector  X,  is  the  n  dimensi 
vmponents  of  the  jth  column w  A.  [“  ay  ~\ 


X.  . 

i  * 


Hi 


L  Anj 
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A 


(2-6) 


Olefine  now  a  new  let  of  state- space  coordinates  by 

x  =  p  y  (2-7) 

The  set  Of  equations  (2-1)  and  (2-2)  defining  initially  the  system  becomes 

jr(k  +  1)  ■  JljM  +  MW  (2-8> 

v  (k)  =  y  y  (k)  +  D  u(k)  (2-9) 

where 

MH4B  (2-10) 

y  »  C  p  (2- 11) 


The  Yj*  S  are  called  the  normal  coordinates  of  the  system.  The  matrix  p  and 
therefore  the  normal  coordinates  are  not  unique.  It  is  always  possible  to  multiply  a 
column  of  p  by  a  given  number  or  to  arrange  the  columns  in  another  order*  By  doing 
so  we  get  another  matrix  which  still  "  diagonalize s”the  matrix  A. 

The  system  of  equations  is  stable  if  Re  <  1  for  all  i*  The  rank  of  the  input 
u  is  defined  as  the  rank  of  the  matrix  B.  If  this  rank  is  ru,  it  means  that  ru  inputs  are 
independant,  the  remaining  (p  -  ru )  being  linear  combinations  of  the  ru independent  inputs. 

The  system  can  be  considered  as  having  ru  inputs.  In  the  same  way,  the  rank 
of  the  output  rv  is  the  rank  of  the  matrix  C  or  y.  It  gives  the  number  of  linearly 

independant  outputs  when  0=0. 

\ 

It  is  always  possible  to  reduce  the  number  of  inputs  by  (p  -  ro)  and  the  number 
of  outputs  by  (q  -  ry)  so  that  the  rank  of  the  input  (output)  is  equal  to  the  number  of  inputs 
(outputs)* 
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2-3.  OBSERVABILITY  AND  CONTROLLABILITY 

These  nations  were  introduced  by  Kalman  [2],  and  Somewhat 
modified  by  Gilbert  [l]  . 

A  system  is  Said  to  be  controllable,  if  $  has  no  rows  of  zeros.  The 
controllable  coordinates  y^  are  the  ones  corresponding  to  non  zero  rows  of  p.  The 

Uncontrollable coordinates  are  the  ones  corresponding  to  zero  rows  of  p.  It  is 

clear  that  uncontrollable  coordinates  cannot  be  influenced  by  the  input.  They 
only  depend  on  initial  conditions  or  on  disturbance  inputs . 

A  system  is  said  to  be  observable,  if  y  has  no  columns  of  zeros. 

The  observable  coordinates  are  the  ones  corresponding  to  non- zero  columns  of  y. 
The  non-obs e r vable  coordinates  are  die  ones  corresponding  to  zero  columns  of  y. 

It  is  clear  that  non- obs e r vable  coordinates  are  the  ones  which  do  not  influence  the 
output. 

2-4.  CONSEQUENCE 

A  System  S  can  always  be  partitioned  into  four  subsystems: 

1.  A  system  S*,  all  the  coordinates  of  which  are  both  controllable 
and  observable  and  having  a  transmission  matrix  D. 

2.  A  system  S°  Such  that  all  its  coordinates  are  observable  and 

uncontrollable . 

3.  A  system  Sc  such  that  all  its  Coordinates  are  controllable 
and  unobservable. 

4.  A  system  such  that  all  its  coordinates  are  uncontrollable^and 

unobservable . 


FIG.  2-3.  PARTITIONING  OF  A  SYSTEM  INTO  FOUR  SUBSYSTEMS 
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The  systems  S°,  Sc,  S*  have  zero  transmission  matrices*  The  proof  of  this  theorem, 
obtained  by  partitioning  a  System  given  by  equations  (2-8)  and  (2-9),  is  given  in  appendix 
I  . 

2-5  CONCLUSIONS  = 

i  A  multivariable  sampled-data  system  can  be  characterized  by  an  n 

dimensional  state-vector.  The  values  of  this  vector  are  known  only  at  the  sampling 
instants.  The  behaviour  of  the  system  between  those  instants  is  undetermined^ 

The  components  of  the  state -vector  are  classified  into  four  categories: 

1)  Some  of  them  are  said  to  be  controllable  and  observable  because  they  are 
affected  by  the  input  of  the  system  and  they  affect  its  output. 

2)  Some  components  which  do  not  affect  the  output  but  are  affected  by  the  input 
are  said  to  be  controllable  and  unobs  Cry able . 

3)  Some  components  which  are  affected  by  the  input  but  do  not  affect  the  output 
are  observable  and  uncontrollable. 

4)  Some  components,  which  are  independant  of  the  input  and  do  not  affect  the 
output  are  uncontrollable  and  unobservable. 

Each  group  of  components  of  the  state  vector  can  be  represented  as  a  subsystem 
of  the  initial  system. 
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SECTION  III 

ELEMENTS  OF  DYNAMIC  PROGRAMMING  W\  ,;[§}_ 

3-1  INTRODUCTION  - 

Consider  a  multivariable  s  ampl  e  d  -  data  system  with  a  p  dimensional  input 
vector  u  (k)  where  k  is  the  kth  sampling  instant. 


u> 


PLANT 


« 


x 


FIG.  3-1.  GENERAL  MULTIVARIABLE  SYSTEM 

It  is  desirable  to  have  the  output  follow  as  closely  as  possible  a  q  dimensional 
reference  input  vector  r  . 

The  output  x  and  the  control  input  u  are  related  by  the  plant  dynamics  which, 
in  the  case  of  a  sampled-data  system  can  be  written  as 

x(k+  1)  =  f[_x_(k),  u  (k)]  (3-1) 

“  \\ 

■v 

In  many  cases  the  possible  values  of  the  control  inputs  are  restricted  by  physical 
consideration.  In  our  problem  it  will  be  assumed  that  there  is  no  strict  limitation  on 
u  such  as  [u|  <  A,  where  A  is  a  given  number.  However  it  will  be  supposed  desirable 
to  have  a  reasonably  small  input  vector.  This  will  be  taken  into  account  by  introducing 
uin  the  performance  criterion. 

Generally,  it  is  impossible  to  get  the  output  to  have  the  desired  behaviour. 

The  general  performance  criterion  may  be  represented  in  the  form 

T 

S  =  J  F(x,  r  ,  u  )  dt  (3-2) 

t 

o 

In  the  case  of  a  sampled  -data  system,  where  the  state  of  the  system  is  known 
at  sampling  instants  only,  this  criterion  may  be  replaced  by 

N 

S  =  J  F  [  x  (k)  ,  r  (k),  «  (k)] 
k=  0 


}  i 


(3-3) 
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This  is  referred  to  as  an  N  stage  process. 

3-2  OPTIMAL  CONTROL  PROBLEM 

The  problem  which  is  posed  now  is  the  following: 

Given  a  performance  criterion  (2-3)  and  an  arbitrary  initial  output  x(0),  deter¬ 
mine  a  sequence  of  control  inputs,  u  °  (O'),  (1), . . .  u°  (N-l)  which  minimises  (or 

maximizes)  S. 

■I 

In  the  following  chapters  two  types  of  performance  criterion  will  be  considered* 

1)  Final  value  p r oblem: 

After  a  certain  number  of  stages  the  output  should  be  as  close  as  possible  to  a 
reference  jr  (k  )  .  Besides,  as  we  have  seen,  the  limitations  on  the  input  is  taken  into 
account  by  Introducing  the  magnitude  of  u  into  the  performance  criterion. 

The  performance  criterion  will  be  of  the  form 

S  =  |x1  (k)  -  rj(k)]  \  [x2(k)  -  r2  (k)  )  2  +  '••  +  (|xq(k)  “  rq(k)  ]’ 

N 

♦  J  fW  +u2  (*)+•••  +up2  (k)  (3-4) 


2)  Regulator  problem  - 

Determine  _u  (k)  which  maintains  x  (k)  as  dose  as  possible  to  a  reference  input 
r(k).  In  addition  u  must  be  as  *  small"  as  possible. 

The  criterion  for  this  case  Is 

N  2  2  2 

S  =  T  -  rl  w]  +[  X2  "r2&>]  +  •••[  xqfr>  *  rqW  \ 

k=  0 


+  u2  (k)  +  u22  (k)  +  . . .  +  up2  (k) 

N 

T 

-Jo  [x  (k)  -  r(k)j  [x  (k)  -  r(k)]  +  U_T  (k)  p(k) 

- y-L.-LH-.il  .»-■  -  -  -  : - : - -  -  -  •-  - - — 

The  notation  A  is  used  for  the  transpose  of  the  matrix  A. 


(3-5) 


*  - 


It  is  noticed  that  expression  (3-4)  is  not  exactly  of  the  form  of  equation  (3-3) 

Both  equations  (3-4)  and  (3-5)  Can  be  represented  by 

S  =  Fq  f  x  (0),  r(6)i  u(0)|+  Fj  [x(l),  r(l),  u(l)]  +  ...+  F^  [x(N),  r(N),  u(N)] 

(3-6) 


which,  for  convenience,  is  expressed  as 

S  =  Fq  (0)  +  F1  (I)  4  . . .  +  Fn  (N)  (3-7) 

In  equation  (3-5)  Fq  t  Fji  Fj. 

in  equation  (3-4)  FQ  =  Fj  =  . . .  =  F^j  ^  Fj^ 


3-3  METHOD  OF  DYNAMIC  PROGRAMMING  -  [s]  ,  M 

1)  Principle  of  optimality  -  [5] 

An  optimal  sequence  of  control  inputs,  u  (0),  u  (1),  . . .  u  (N-l),  has  the  property 
that  whatever  the  initial  state  x^(0)  and  the  initial  choice  of  u  (0)  are,  the  remaining 
sequence  u  (1),  u  (2),  „  ,  u  (N-l)  must  constitute  an  optimal  sequence  for  the  N-l  stages 
process  starting  at  k  =  1,  with  the  initial  state  x_(l). 

2)  This  principle  provides  a  method  to  solve  the  problem  of  determining  a  sequence 
u  (0),  u  (1), . .  ,u  (N-l)  which  minimizes  a  performance  criterion  given  by  eq.  (2-6). 

Let  [  x  (0)]  be  the  optimum  value  of  S  for  an  N-l  stage  process  starting  at 
k  =  0  with  the  initial  state  x  (0). 

Thus  SN  j  [  x  (1)  ]  will  be  the  optimum  value  of  S  for  an  N-l  stage  process 
starting  at  k  =  1  with  the  initial  state  x  (1). 

The  mathematical  translation  of  the  principle  of  optimality  can  be  written  as : 
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The  method  will  consist  In  a  "  stage  by  stage  Optimization"  . 

Consider  first  a  one  stage  process.  The  performance  criterion  is 


(3-9) 


This  equation  determines  u(0)  for  a  one  stage  process;  it  will  be  u  (1)  for  a 
two  Stage  process,  u  (2)  for  a  three  stage  process,  u  (N-l)  for  a  N  stage  process. 

Consider  now  a  two  stage  process;  u(l)  has  been  determined  by  the  proceeding 

step. 

To  determine  u  (0)  consider  the  expression,  derived  from  the  principle  of 
optimality 


f  *  (0)1  =  min  f 
1  u(0)  1 


N-l 


(0) 


(1)  ] 


(3-10) 


In  this  expression,  it  is  possible  to  replace  x(l)  by  its  expression  given  by 
eq.  (3-1) 


x(l)=  f[x(0),  u(0)] 


(3-U) 


Then  £x_(0)J  depends  only  on  x_  ( 0 )  which  is  known  as  an  initial  condition,  and 
on  u(0).  It  is  then  possible  to  determine  the  optimal  u  (0).  The  process  can  be  repeat¬ 
ed  N  times,  and  each  step  will  determine  a  member  of  the  optimal  sequence  u(0), 
u(l),  ..,u(l),  , .  ,u(N-l). 


3-4  OPTIMIZATION  IN  STATE-SPACE- 

Consider  a  system  given  by  Eqs.  (2-8)  and  (2-9).  The  problem  is  to  determine 
a  sequence  of  control  inputs  u(Q),  u(l),  ...  u(N-l)  which  minimizes  a  performance 
criterion  of  the  form  of  equations  (2-4)  or  (2-5). 

In  these  expressions  for  S,  it  is  always  possible  to  substitute  v^(k)  by  the  way 
of  equation  (2-9)  and  to  get,  for  the  performance  criterion,  an  expression  involving 
the  state  vector  and  the  control  input.  It  is  then  possible  to  carry  on  an  optimization 
process,  just  by  considering  a  plant  with  an  output  vector  x  ,  a  control  input  uand  a 
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dynamic  behaviour  behaviour  characterized  by  equation  (2-8). 


o—  -• — — 

Eqs 

|q 

u(k) 

(2.8)  and  (2-9) 

vfk) 

UCO 

2.8 

x(k) 

Fid.  3-2.  STATE-VECTOR  CONSIDERED  AS  THE  NEW  OUTPUT  OF  A  SYSTEM 

Thii  is  referred  to  as  H  optimization  in  state -space"  .  It  is  the  type  of  optimization  that 
will  be  considered  in  section  IV  and  V. 


n 


dynamic  behaviour  behaviour  characterized  by  equation  (2-8). 


fttr - - 

Eqs 

Eq 

a(hj 

(2.8)  and  (2-9  ) 

*.(*) 

!L<k) 

2.8 

FIG.  3-2.  STATE-VECTOR  CONSIDERED  AS  THE  NEW  OUTPUT  OF  A  SYSTEM 

Thie  la  referred  to  at  *  Optimization  in  atato- apace"  .  It  la  the  type  of  optimization  that 
will  be  conaidered  in  eection  IV  and  V. 


SECTION  IV 


OPTIMIZATION  WITH  DESIRED  FINAL  VALUE- 


4*1  *  INTRODUCTION^, 

Let  a  multivariable  sampled -data  system  be  represented  by 

x(k  +  1)  =  Ax  (k)  +  B  u(k)  (4-1) 

v(k)  =  Cx(k)  +  Du(k)  (4-2) 


u  (k):  p  dimensional  input  vector 
v  (k)  q  dimensional  output  vector 
(k)  x  dimensional  state  vector 

A  :  n  row,  n  column  matrix  which  can  be  made  symetrical  (cf  section  II) 

B  :  q  row  n  column  matrix 
D  :  q  row  p  column  matrix. 

Let  r  (k)  be  a  given  q  dimensional  reference  input  vector. 

Consider  now  an  N  stage  process  where 

1)  At  the  end  of  die  process  the  output  y  should  be  as  close  as  possible  to  the 
reference  input  r, 

2)  The  average  value  of  the  magnitude  of  u  ,  during  the  process  should  be  as 
small  as  possible,  A  convenient  performance  criterion  will  be 

T 

S  =  fv(N)  -  r(N)]  [vW-r(N)1  +  £  u  (k)  u  (k)  (4‘ 

k=  0 

The  problem  is  to  determine  a  sequence  of  inputs  u(0),  u  (1), . .  ,u  (N-l)  so  that  S  is 
minimum. 


13 


The  problem  depend  1  of  course  on  a  certain  number  of  Initial  conditions.  If 
the  order  of  the  system  is  n,  the  state-vector  has  n  components  and  the  system 
depends  generally  on  n  initial  conditions  (the  case  where  this  statement  is  not  true  will 
be  examined  later).  It  will  be  assumed  that  the  initial  state  is  given  by  the  components 
of  the  state-vector  at  the  instant  aero.  In  other  words  x  (0)  is  assumed  to  be  a  known 
vector. 

In  the  case  where  the  components  of  the  state  vector  do  not  depend  on  u  (this 
is  the  case  when  the  driving  function  depends  on  u(k)  only)  the  initial  state  can  be 
given  by  the  components  of  the  vector  outputs  at  instants  0,  1. 2, . . .  m,  m  depending 
on  the  respective  values  of  n  and  p.  If  a  *  m  p  +  a  with  a<  p  and  m  and  a  integers  x(o) 
will  depend  an  v(0),  v  ( l),  . . .  v  (m )  and  a  components  of  v(m  +  l). 

As  a  sample  example  consider  a  nth  order  single  .-input,  single  output  system 
v(k  +  n)  +  an_j  v(k  ♦  n  -  1)  +....  +  a  v(k)  s  bQ  u(n)  (4-4) 

A  set  of  appropriate  state  variables  are 

(k)  =  V(k) 

*2(k)  a  v(k  +  l) 


x^k)  a  v(k  +  n  -  l) 


x(0)  = 


v(0) 

v(l) 

v(2) 


v(n-l) 


14 

It  Is  important  to  notice,  that,  in  the  case  of  a  sampled* data  system,  the 
"initial  state"  of  the  System  does  not  mean,  like  in  the  continuous  case,  the  state 
of  the  system  at  the  Instant  zero.  but  can  require,  for  instance,  the  knowledge  of 
the  output  at  a  later  instant*  It  is  dear  that  equation  (4*4)  defines  the  variable  v(k) 
under  the  condition  that  v(0),  v(l), . . .  v(k-  1 )  are  given  as  "initial  conditions  " . 

S  will  be  minimised  by  the  method  of  dynamic  programming  discussed  in 
Section  III.  Let  ^x  (o)  J  be  the  minimum  value  of  S  for  an  N  stage  process  which 
starts  at  k  *  o  with x  (o)  specified.  The  different  S' s  are  related  by  the  following 
relations 


Sj  |x  (o) 

1  *  min 

1  U  (0) 

(lx 

(o)  -  r  (o)j  T  [  v  (o)  *  £  (o) 

'  ]  +u  T  (o)u  (o)| 

(4-5) 

s2  [  1  <°>] 

-  min 
a  (o) 

Wi 

.  0)]  +  uT  (o)u  (o)} 

(4-6) 

S3  x  (o) 

i 

# 

=  min 

U  (o) 

(l)  j  +  u  T  (o) (o)| 

(4-7) 

e 

SN  *  (o) 

=  min  | 
u  (o) 

>N-l' 

[x  (1)]  +u  T  (o)  U  (o)} 

(4-8) 

4.2.  ONE 

;  STAGE F 

•ROCE! 

5S 

The  optimum  value  of  U  (o)  in  tills  case  is  given  by  eq.  (4-5) 


si  [_*  (°)]  *  min  |  ^  v  (o)  -  £  (o)  j  T  [  v  (o)  -  r  (o)j  +u  T  (o)u  (o) 


or  else 


Sj  (o)  j  -  min^  j  £  C*  (o)  +  Du  (o)-£(o)  |T[Cx  (o)  +  Du  (o)-£  (o)|  +  uT(oXi  (o)j  (4-9) 

Eq.  (4-9)  is  an  expression  involving  all  the  components  ofu  (o).  Letting  all  the 
8Sj  0S2  8S 

derivatives  (0y  » •  •  qu  ^  equal  to  zero  and  condensing  the  result  in 

1  2  p 

matrix  form.  (o)  (i.e..  u  (o)  optimum  for  a  one  stage  process)  is  given  by  (cf 
appendix  II) 
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dt  [gx 

(o)  +  D  u  ®  (o)  -  r  (o)  ]  +  u  j  (o)  *  0 

,(4-10) 

or 

u®  »  Oj[r  (o)  -  Cx  (o)  ] 

(4-11) 

where 

U ,  “  (I  +  DTDf 1  DT 

(4-12) 

In  this  ease  the  result  can  be  made  particularly  Simple  by  noticing  that, 
according  to  Eq.  (4-2) 


v  (o)  *  C  *  (o)  +  Dp  (o) 

Equation  (4-10)  can  be  written  as 

DT  £v  (o)  -  £  (o)  j  +  U  1  (o)  *  o  (4- 13) 

Hence 

U  j  (o)  «  DT  [r  (o)  -  v  (o)  (4-14) 

Consequently,  the  controller,  in  the  case  of  a  one  Stage  process  can  be 
synthesised  by  simple  feedback*  This  will  be  true  for  the  last  stage  of  any  multi¬ 
stage'  process* 


-t  -*-*» _ . 

0T 

u_ 

PLANT 

v 

FIGURE  4- 1.  CONTROLLER  FOR  A  ONE  STAGE  PROCESS 


The  actual  minimum  value  of  S 


[6 


is  then: 


sl[-  (°)]  “  [C- (o)  +  D  ui  fe  (o>  -  Cx  (o))  -  r  (o)]  T  [cx  (o)  +  D  U  j  (r  (o)  -  Cx  (o))-r(o)j 
+|  r  (o)  -  Cx  (o)  j  U^ujr  (o)  -  C  x  (o)] 


(4-15) 
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Let 


Hj  *  (D  Uj  *  I)T  (D  Uj  -I)  4  U^Uj 


H |  is  a  symetrlcal  matrix  which  depends  only  on  tile  matrix  D 
S  i  [ a  (o)  Jean  be  written  in  the  form 

Sf  I  *  (O) j  -  [r  (o)  -  Cx  (0)  ]T  Hj[  r  (o)  -  Cx  (o) J 

Which  shows  that  S  j  (o)  J  is  a  linear  form  of  the  vector  £  (o)  -  C  x  (o) 

In  the  rather  frequent  case  where  Da  O,  Uj  is  the  aero  matrix  and  H ^ 
the  identic  matrix 


Uj  ■  O 


Hj  a  I 


and  S ®|x  (o)  J  optimum  is  equal  to  the  magnitude  of  the  vector  £  (o)  -  Cx 
4. 3.  TWO  STAGE  PROCESS 


The  error  criterion  for  a  two  stage  process  is 

T 


S2[x  (o)]  -  Sj  [  x  ())]  4  uT  (0)  u  (o) 

«  (rCD-  Cx  (1)  ]T  Hj[  r  (1)  -  Cx(l)J+  uT  (o)  u  (o) 


Equation  (4-1)  for  k  *  o  shows  that 

x  (1)  *  Ax  (o)  4  D  u  (o) 

Hence 

S2[x  (o)]  «(  r  (1,  -  C  Ax  (o,  -  C  Bu  (o)  ]  Hj[  £  (1)  -  C  A  x  (o)  -  C  B  u  (o)J 

4  UT  (o)  u  (o) 

The  result  shown  in  appendix  II  gives  u^  (o)  by  the  equation 
-(CB)T  Hj'[r  (l)-CAx  (o)-CB  uj  (o)J  4  uj  (o)  *  o 


or 


U2(o)«  U2[  r  (1)  -  C  Ax 


(4-16) 


(4-17) 

is 


(4-18) 


(4-19) 


(4-20) 


(4-21) 
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U2*  [  I  +  C  BT  Hj  C  B  ]  C  BT  Hj  (4-22) 

The  minimum  value  of  the  performance  criterion  for  two  stages  is 
*!{*<•)}  ~  [£(l)-CAx(o)-C  B  U2  (r(l)-CAx(0))jTH1[^r(l)“ C A x (o )- C  B  U2(r(l)-CAx  (o))] 
+  (*  (i)  -  c  A  x  (o)j  TU2TU2[r  (1)  -  c  AX  (o)j 

or 

$2[  x  (0)]  *=  [  r  (1)-  CAx  (o)  ]T  H2  [  r  (1)  -  CAx  (o)]  (4-23) 

where 

M2  -  [  I  -  G  B  U2]  THj  [i  -  C  B  U2]  +  U2TU2  (4-24) 

In  equation  (4-23),  is  a  aymetrical  matrix. 

The  Synthesis  of  the  controller  requires  the  knowldege  a  priori,  of  r  ( 1). 

The  value  of  u2  (o)  can  be  then  precalculated,  but  the  controller  cannot  be 
synthesized  by  feedback. 

In  the  case  where  the  components  of  the  state- vector  are  either  uncontrollable 
Or  unobservable,  then  C  B  =  O,  therefore  u2  s  0. 

This  result  could  have  been  easily  predicted.  In  this  case  the  v's  cannot  be 

T 

influenced  by  the  u's.  So  S  will  be  minimum  for  u  (°)  u  (o)  *  o  i.  e.,  u  (o)  -  o. 
CONCLUSION  * 

The  input  which  optimizes  a  one  stage  process  is 
=  Uj[  r  (o)  -  Cx  (o)  J 

The  sequence  of  input  which  optimizes  a  two  stage  process  is 
u  2  (o)  =  U2  [  r  (1)  -  C  Ax  (o)  ] 
u°  (1)=  Uj(  v  (1)  -  C  x  (1)] 

The  U's  are  p  rows  q column  matrices  depending  on  A,  B,  C,  D. 

S°  f  _x  (o)j  is  a  linear  form  of  the  vector  r(o)-Cx  (o).  §2  ^x  (o)  J  is  a 
linear  form  of  the  vector  _r  (o)  -  CAx  (o). 

Those  results  can  be  generalized  for  an  N  stages  process. 

4.4.  N  STAGE  PROCESS 

Assume  that  for  an  N-l  stage  process  the  error  criteron  is 
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SN_i|  x  (o)]  *  {  r  (N-2)  -  C  AN“2  x  (o)j  H^jJf  (N-2)  -  C  A  N“2x  (o)  ]  (4-25) 

Where  HN_  ^  Is  a  qx  q  aymetrical  matrix. 

For  an  N  stage  process  the  error  criterion  is 

SN[x.  (o) ]  =  SN_X  [x  (1)]+  uT  (o)  u  (o) 

__  _  .  T  -  - 

«  Jr  (N-l)  -  C  AN“2x  (1)  J  H.^jJr  (N-l)  -CAN"2xll)]+ uT(o)  j  (o) 

or  else 

S  N  [  x (o)]  •  (  r(N-  1)-CAN"  1x(o)-CAN“2Bu(o)]  THn_  j[  r(N- 1  )-CAN~  1x(o)-CAN”2Bu(o)] 

+  u  ^  (o)  tj  (o)  (4-26) 

The  result  shown  in  appendix  II  gives  the  equation  giving  u  ^  (o) 

-  (CAN“2B)T  HN-1[r  (N-l)  -  CA^x  (o)  -  CAN-2B  »  °  (o)  ]  +  u  °  (o)  *  0 

or 

|JWS  UN  t £  (N-i)  -  C  A  N_1  X  (°)J  (4-27) 

where 

UN  •  [i  +(C  AN"2B)T  Hn_  j  (C  a  N‘2B)]  * 1  (C  AN-2B)T  Hn_  j  (4-28) 

This  shows  that  u  ^  (o)  is  a  linear  function  of  r  (N-l)  and  of  x  (o).  Therefore 
£  (N-l)  has  to  be  known  before  the  process  starts. 

The  minimum  value  of  the  performance  criterion  is  then 

S  °  [x  (o)]  •  [r  (N-l)  -  CAN“^x  (o)  ]  Hn  [  r(N-l)-  CAN-1x  (o)J 

where 

HN.  (i.c  an*?b  on]  hn_,  [i.oan-?b  on]+  w/on 

Equation  (4-30)  can  be  interpreted  as  a  recursion  formula  between  the  H' s  with  the 
initial  value 

Hj  ■  [  I  4  DTD  ]  _1 


(4-29) 


(4-30) 
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Therefore  It  is  possible  to  compute  all  the  H's  using  eq.  (4-30)  and  deduce 
the  U's  via  eq.  (4-28). 

This  work  can  be  programmed  In  advance  on  a  computer  and  the  U's  can 
be  known  a  priori. 

CONCLUSION 

For  an  N  stage  process,  the  sequence  of  optimal  inputs  is 

u  ®  (o)  *  UN[  r  (N-l)  -  CAN_  1  x  (0)  j  (4-31) 

UN-1  [r  (N-1)  *  CAN"2x  (1)]  (4-32) 

a  5  (2)  *  UN_2  [  r  (N-l)  -  CAN_3x  (2)]  (4-33) 

u  °  (N-l)  *  Ujr  (N-l)  -  C  x  (N-l)] 

x  (o)  being  known,  u  ^  can  be  computed;  and  this  cannot  generally  be  done 
by  feedback  for  x  (o)  can  depend  on  the  state  of  the  System  at  later  instants.  A 
synthesis,  using  feedback  will  then  be  possible  in  the  Only  case  where  the  order 
of  the  system  is  equal  to  the  rank  of  the  output. 

For  the  next  step,  x  (1)  is  given  by 

.  x  (I)  a  Ax  (o)  +  B  u  j  (p) 

Eq.  (4-32)  gives  then  u^  (1),  and  so  on. 

The  sequence  of  optimal  inputs  has  to  be  precalculated,  and  fed  into  the 
plant  at  the  proper  instants. 

All  the  expressions  involve  A  to  a  certain  power.  Thus  it  is  advisable  to  treat 
the  problem  in  the  state  variables  which  diagonalize  A> 
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n 

(4-34) 


n 


n 

4.5.  CASE  WHERE  SOME  COMPONENTS  OF  THE  STATE-VECTOR  ARE 
UNCONTROLLABLE  OR  UNOBSERVABLE. 

N- 1  ■ 

The  coefficient  of  x  (o)  in.  Eq.  (4-27)  is  CA  .  If  softie  of  the  coordinates 

are  unobservable  C  has  nc  4  n  columns  of  zeros  (wjiieh  can  hi  ways  be  the 
c  ■  £  - 

n  +  n  l&st  ones  . 

C  can  be  written  as : 


Ai 


an. 


c  * 


J  o  o 

I  o  o 
I  o  o 
I  o  o 


c  ,  f 
n  +n 


(4-35) 


where  n '  =  n*  +  n°  =  number  of  observable  coordinates.  On  the  other  hand>  A^""* 
is  a  diagonal  matrix  given  by 


i  N- 1 


(4-36) 


Consequently 


cn  k  i 


j  0 

0 

1  o 

0 

lo 

0 

(4-37) 


C,A, 


c  1  x  ,^ml  !  o  o  r 

nun  I  J  J 


C>  f 
n  +n 


The  n6  4  n*  last  columns  of  GA^“  are  zeros .  As  a  consequence  u  (o)  does  not 
depend  on  the  unobservable  coordinates  pf2c  (p). 

This  result  could  have  been  predicted.  The  unobservable  Coordinates,  by 
definition,  do  not  affect  the  output;  So  they  do  not  appear  in  the  expression  of  S. 

As  a  result,  the  optimization  Can  be  Carried  on  systems  S*  and  S  °  and  system 
Sc  and  S*  can  be  forgotten.  The  order  of  the  system  is  n*  +  n°  and  the  problem 
depends  on  a*  +  n°  initial  conditions,  which  are  the  components  of  vector  £*(o)  and 
_y°(o). 

Consider  now  the  equation  v  =  v*  +  v°  which  states  that  the  actual  output  of 
the  system  is  equal  to  the  sum  of  the  "controllable  and  observable"  part  and  of 
the  observable  but  uncontrollable  part.  Saying  that  v  should  be  as  Close  as  possible 
to  a  reference  input  £  is  equivalent  to  Saying  that  yf*  should  be  as  close  as  possible 
to  a  reference 

r'  =  r  -  v°  (4-38) 

v°  depends  only  on  the  vector  y°(o)  but  is  independant  of  a»  .  It  is  thus  possible  to 
determine  v°  and  therefore  £ '  a  priori,  before  starting  any  optimization  process* 

CONCLUSION 

Instead  of  carrying  on  an  optimization  process  over  an  n4  +  n°  system  with  a 
reference  input  £,  it  is  possible  to  carry  out  the  optimization  on  the  n*th  order 
system  S*,  with  a  reference  input  r' s  r  -  v° 
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Finally  the  case  where  all  coordinates  are  either  uncontrollable  or  unobser¬ 
vable  (no  system  S*)  has  already  been  mentioned*  In  this  case  the  output  is 
disconnected  from  the  input  and  the  control  problem  has  no  solution*  The  only  thing 
to  do  to  minimise  S  Is  to  set  U  ■  0* 


1 


FIGURE  4-3.  CASE  WHERE  ALL  COORDINATES  ARE  EITHER 
UNCONTROLLABLE  OR  UNOBSERVABLE. 


4.6.  EXAMPLES 


Example  1 

Consider  a  tdrp  inputs  two  outputs  system  as  shown  in  fig*  4-4  characterized 
by  the  equations 


r  Vj  (k  +2)  +  3  (k  +  1)  -  2  v2(k)  *  Uj  (k) 

Vj  (k  +1)  +  3  Vj  (k)  +  v2  (k  +1)  +  3  v2  (k)  *  u2  (k) 


(4-39) 

(4-40) 


U|  o* 
UgO 


■O 


■o 


V2 


FIGURE  4-4.  TWO  INPUTS,  TWO  OUTPUTS  SYSTEM 
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A  tat  of  appropriate  atate-variables  is 

*j  <k)  *  Vj(k) 


*2  (k)«  Vj  (k  +  1) 


V,  (k) 


(k)  * 

'Vi  (k)' 

u  (k)  - 

i - 

H 

sT 

>2  W: 

.  «2  (kL 

The  Initial  conditions  are  Stated  by  the  vector 


x  (o) 


Vj  (o) 

Vj  (1) 

V,  (o) 


The  dynamics  of  the  plant  are  defined  by  the  equations 


u  (k) 


'  O  1  O' 

"0 

o' 

*  (k+1)  - 

0-3  2 

-3  *1  -3 

k  (k)  + 

1 

0 

0 

1 

v(k)  * 

r  i  ©  o* 

10  0  L_ 

]  *  W 

The  normal  coordinates  are  defined  by 

*  (k)  ■  p  ^  (k) 

where 

'  1  -1  1  * 

pm  -1  2  -3 

..1  1  O  J 


The  plant  dynamics  are  defined  by  the  new  set  of  equations : 


(4-41> 


(4-42) 


(4*43) 


(4-44) 
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li  o  o~ 

■-i  r 

£  (k+1)  ■ 

0  -2  6 

*  (k)  4 

1  2 

W 

I 

o 

o 

_ J. 

O  1 

U  (k) 


(4.45) 


(4*46) 


The  system  is  supposed  initially  relaxed  x  (o)  *  jr  (o)  * 


1.  STAGE  PROCESS 


As  D  *  O  Uj  »  O  HjS  I 
Uj  (o) =  O 

2 .  Stage  process 


is  given  by  eq.  (4-22). 


C  B 


.  1  •'  ‘1 
Ui  i  o  J 


-l  i 
1  2 
O  1 


1  ' 
7 

14  - 


2*2  (o) 


for 

uj  (1)*  O 


I  (1) 


jc  <°)  *  5L 


(4-47) 
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If  the  process  has  more  than  two  stages  It  is  necessary  to  compute 
given  by  equation  (4-24).  The  result  is 


130 

57 

49 

98 

H2  *  ; 

57 

"ir 

41 

W 

Example  2 

Consider  the  single-input,  single^output, second  order  system 
v  (k  +  2)  -  -J  v  (k)  =  u  (k+  1) 

The  state  vector  can  be  chosen  of  the  form 

x  j  (k)  =  v  (k) 

x2  (k)  =  v  (k.  +1)  -  F,  u  (k) 

then 

x  j  (k  +  1)  *  x2  (k)  +  Fj  u  (k) 

x2  (k+  1)  =  |  Xj  (k)  +  F2  u  (k) 

Fj  and  F2  are  determined  by  writing 

x2(k+  1)«  v(k+  2)  -  Fj  u  (k+l)  =  -j  v  (k)  +  F2  u  (k) 

v  (k+2)  v  (k)  +  Fj  u  (k  +  1)  +  F£  u  (k) 

On  the  other  hand 

v  (k  +  2)  =  V  (k)  +  u  (k  +  1) 


Comparing  eq.  (4-54)  and  (4-55)  gives  Fj  and  F2 


F,  -  I 


*1  *  o 


(4-48) 


(4-49) 

(4-50) 

(4-51) 


(4-52) 

(4-53) 


(4-54) 


(4-55) 
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Finally  the  atate  vector  is 


x  Oc)  * 


v  (k+1)  -  u  (k) 
and  the  plant  dynamics  can  be  written  as 


'  o  r 

’  O  ' 

x  (k  +  1)  = 

*  (k)  + 

1 

u  (k) 


v(k)  s[i  o]  X  (k) 
The  normal  coordinates  can  be  defined  as 


x  m 


i  i 
i  -i 

it  7J 


and  the  normal  form  representation  is 


"i  o“ 

'  1  " 

2  (k  +  1)  * 

7 

2(k)  + 

7 

L<HJ 

1 

v  (k)  a  [ 

>  i] 

J(W 

One  stage  process  . 

As  the  transmission  matrix  D  «  O  the  optimal  input  is  (cf  4-2) 


u?  “  O 


Two  Stage  process. 


Ug  is  given  by  eq.  (4-21)  and  (4-22) 


r  i 

5  1’ 

CB»[l  l] 

I 

.  1. 

eq.  (4-22)  gives 


U 


3 

1 


3/2  _  6 

2"  ~rr  ~  T3 

•  +  <i> 


(4-56) 

(4-57) 

(4-58) 

(4-59) 


and  equation  (4-22)  gives 


u2  (°)  *  T3  [r  W  m  1  V-!  (o)  +-j  ya  (6)  ] 


(4-60) 


u|  (1)  =  6 

Three  stages  process. 

Eq.  (4- 30)  gives  H2  *  TST 

and  Eq.  (4-28)  gives 

CAB  H, 

U,-  - \ - 

J  1  +  (CAB;  H2 


CAB  * 


1 

* 


(4-61) 


U3^  0.12 

U3 

(o)  =  0.12 

Yl  (6) 

y2  (o)  ] 

(4-62) 

U3 

-P 

11 

[r  (2)-^ 

yj  (o)+2 

y2  (o)  ] 

(4-63) 

*** 

(2)  *  O 

(4-64) 

Example  3 

Case  where  some  components  are  uncontrollable  or  unobservable. 

Let  a  third  order  one- dimensional  input,  one-dimensional  output  system 
be  given  by 

(4-65) 

(4-66) 


ri 

t 

o 

p 

1 

x  (k  +  1  )= 

o 

-1 

p 

x  (k)  + 

i 

1 

p 

p 

1 

P 

v  (k)  =  [  1  O  l]  x  (k) 


The  system  is  ini  tally  relaxed. 

The  third  coordinate  is  uncontrollable,  the  second  unobservable. 
The  system  S°  is  characterized  by 
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Therefore  v°  (k  +  I)  ■  v°  (k)  =  v°(o)  “  o 


. .  _  O  _ 

r’  =  r-v  =  r 


The  optimization  process  can  be  carried  out  Using  the  equations 

x  j  (k  +  1)  =  -j  Xj  (k) 

v(k)  *  Xj  (k) 


Which  are  equivalent  to 


v  (k  +  1)  =  1  v  (k) 


(4-67) 


In  this  case  an  optimization  in  the  state-opace  is  equivalent  to  an  optimization  with 
respect  to  the  actual  output* 


Consider  the  cascade  connection  of  the  two  systems 

|  ya  (k  +  1)  =  -  ya  (k)  +  ua  (k) 

®a  1  va  (k)  »  ya  (k)  +  ua  (k) 


(4-68) 


ivb  (k)  a  yb  (k)  -  Uh  (k) 


Uq  «  u 


FIG.  4-5.  CASCADE  CONNECTION  OF  TWO  SYSTEMS 
The  state  vector  of  the  overall  system  S  can  be  taken  as 
X1  “^a  'Z*  *b 


29 


The  system  S  can  be  represented  by 


f-i  °]  I, 

(k  +  1)=^  j  _2J  x  (k)  +[  j  ]  U 


(k) 


(4-70) 


v  (k)  »  [l  -l]  x  (k)  -  u 


(4-71) 


and  for 


O 


1  1 


The  normal  form  representation  is 


£  (k  + 1  )■* 


-1  6 
O  -2 


*(k)  + 


1 

O 


v  (k)=  [O  -l]  jjr  (k)  -  u  (k) 

All  coordinates  are  either  uncontrollable  or  unobservable.  Even  though 
and  spearately  can  be  optimized*  their  cascade  connection  is  such  that  input 
and  output  are  disconnected  and  the  optimization  problem  is  meaningless. 


SECTION  V 


REGULATOR  PROBLEM 


5.1.  Introduction 

In  this  section  the  regulator  problem  is  considered  that  is.  the  output 
v  is  desired  to  follow  as  closely  as  possible  a  reference  input  r  and  besides  u 
should  be  as  "small"  as  possible. 

The  expression  to  be  minimized  is 


S  a  £  [  v  (k)  -  r  (k)  ]  T  [  v  (k)  -  r  (k)  ]  +  uT  (k)  u  (k) 

■  k=o 


(5-1) 


The  plant  is  still  described  by  the  set  of  equations'  discussed  in  Section  II 


x  (k  +  1)  =  A  x  (k)  +  B  u  (k) 
v  (k)  =  C  x  (k)  +  D  u  (k> 


(5-2) 


The  initial  conditions  are  given  by  the  componants  of  the  state-vector  at 


instant  o 


x  (o)  = 


Xj  (o) 
x2  <°> 


xn- 1  (o) 


(5-3) 


Let  SN  £  x  (o)j  be  defined,  as  explained  in  Section  III,  as  the  minimum  value  of  S 
for  an  N  stages  process  starting  at  k  =  o  with  the  initial  value  x  (o).  The  set  of 
following  equations  can  be  written 

S  i  [ x  (o) ]  =  min  {  £  v  (o)  -  r  (o)  j v  (o)  -  r  (o)j  +  uT  (o)  u  (o)^  (5-4) 


«  min  |  Sj  ['  X  (1)  ]+[  v  (o)  -£  (o)]  T[  v(o)  -» jr  (o)  j  +  uT(o)  u  (o)j  (5-5) 
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Sn[5 


min  |  SN-1  j"  x  (l)j  +  |  v  (o)  -  r  (o)jTj^  v(o)  -£  (o)J  +  u^(o)  j  (o)  j.  (5-6) 


The  optimization  process  will  be,  as  explained  in  section  III,  the  so-called 
"dyanamic  programming "  process. 

5. 2.  One  stage  process 

The  expression  to  be  minimized  in  the  case  of  a  one- stage  process  is 
Sj|  x  (o)J  -  min  (o)  -  r  (o)jT|  V  (o)  -  r  (o)j  +  pT  (o)  u  (o)  j.  (5-7) 

The  minimization  of  this  expression  has  already  been  studied  in  3-2.  In 
this  case  the  controller  can  be  synthesized  by  simple  feedback  and  the  optimal 
input  is  given  by 

uf  =  U|f£  (©)  -  c  n  (d)j  (5-8) 

Where  Uj  *  [l  +  DTd]  DT 

or 

uj°  =  DTj^  r  (o)  -  y  (o)  j 
The  minimum  value  of  j^x  (o)j  is  given  by 

Sj[  x  (o)]  =[?  (o)  -  C  *  (o,]T  Hj  [  r  (o)  -  C  x  (o)]  (5-9) 

Where  Hj  is  a  symetrical  matrix. 


2,  3.  Two  stage  process 


The  expression  to  minimize  is  given  by  Eq,  (5-5) 

S2[£(o)]  =[r(l)-Cx(l)]T  Hj[  r  (1 )  -  C2  (1 )]  +[v(o)-r(o)]T[v(o)  -£(o)]T+ uT(o)u(o)  (5-10) 

or  using  eq  (5-2) 
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S2[x(o)]»[  r(l)-CAx  (o)-CB  u(o)]T  Hj[  r(I)  -  CAx(o)  *  CBu(o)j 

+  |'C  x(o)  +  Du  (o)sr(o) j  ^  ^C  *(o)  +  D  u(o)-r(o)  j  +  U^(o)  u  (o)  (5- 1 1 ) 

The  computation  given  in  Appendix  III  shows  thatu2°(o)  is  given  by  the 

equation 

(-CB)T  Hj  [r  (1)  -  CAx  (o)-CB  u  <o)J  +  DT  [c  x  (o)  +  D  q  (o)-r(o)]+ u  (o)  =  o  (5-12) 


u  °  (o)  =  uj2)  x  (o)  +  U(2)  r  (o)  +  U  (2)  r  (1)  (5-13) 

O  1 

where 


u<2>  =  - 

X 

.  (CB)T  Hj 

CB  +  Hj 

” 1  [  (CB)T  Hj  CA  +  DTc] 

(5- 14) 

o<2>  . 
re 

’  (CB)T  Hj 

CB  +  Hj 

f1  dt 

(5-15) 

u(2)  •- 

[  (CB)T  Hj 

CB  +  Hj 

j-1  (CB)T  Hj  CA 

(5-16) 

The  result  can  be  written  under  a  more  condensed  form  by  introducing  the 
2q  dimensional  vector 


R2<o)  = 


(5-17) 


The  index  2  means  that  the  vector  is  2q  dimensional* 

More  generally  the  vectors  R^.  (o) »  Rj^  (1)  •  •  are  defined  as 
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Ik  <°>  * 


£  (6) 
I  (I) 


Kq  dimensional 


£  (1) 

£  (2) 

f  (K  +  1) 


Let 


V21  * [«  «>  •»] 


Eq.  (5-13)  can  be  rewritten  as 

U  2°  (o)  •  Ux{2)  n  (o)  +  Ur(2)  R2  (o) 
Similarly  Eq.  (5-8)  shows  that 

»2  (j)“  Uj|1)£(D  +  ll  <*> 

Where  . 

U  U'  =  -  U.  C 
x  1  - 


U 


(1)  ... 


y. 


R  V1 

It  is  now  possible  to  compute  the  minimum  value  of  S2  x  (o) 


(o)j  * 


£  (!)  -  CAn  (o)  -  CB  (u^2)n  (p)  +  u^2)  R2(o))  THx 


(2) 


(2) 


C  X  (o)  *  D  (U^'  X  (o)  +  UR'fc'  R2(o)  -  r  (p) 
0«>  x(.)  +  U«>  R2  (oil T  [  ] 


(5-18) 


(5-19) 


(5-20) 


(5-21) 


(5-22) 


This  expression  is  a  linear  form  of  the  two  vectors  x  (o)  and  R2  (o).  It. 
can  be  written  as  follows 


Where  H^.  K^.  are  symmetrical  matrices  depending  on  A,  B,  C.  D. 

3-4.  Three  Stage  process 

The  expression  to  be  minimized  in  this  case  is 


S3[x  (o)]=  xT  (!)  H2x(  1)  4  R2T  (1)  K2  R2  (1)  4xT  (1)  L2  R2  (!) 
4  [v  (o)  -  ir  (o) ]T  ^  V  (o)  -  £  (o)l  +  UT  (o)  u  (o) 


(5-24) 


or  if  x  (!)  is  Substituted  by  die  way  of  Eq.  (5-2) 

S3[x  (o)j*  |Ax  (0)  4  Ba(o)]T  H2  JAx  (0)  +  B  q  (o)]+  R2T(1)  K2  R2  (!)  (5-25) 

+  [a  x  (o)4Bu(o)]  T  B2R2  (1)  4  ^C_x_(o)4Du(o)-jr(o)j  T  Cx(o)4Du(o)-£(o)j  +  uT(o)u(o) 

Therefore  u°  (o)  is  given  by  the  following  equation  (cf  Appendix  III) 

2  BTH2  [A  x(o)  4  Bu  (o)  j  4  <|)  +  DT  [c  x(o)  4  D  u(o)-r(o)]  4  u(o)  =  o  (5-26) 


u  3  (o)  *  -  [  I  +  2BTH2B  4  PT©  [  (2BTH2A  4  DTC)  x(o)  4  BTK2R2(1)  4  DTr  (o)  j 

(5-27) 


This  can  be  rearranged  as 

J  3  <°>  *  ^3)  x(o)4  U^3)  R3  (o) 


(5-28) 


Substituting  this  value  of  Uj  (o)  in  the  expression  of  it  is  clear  that 

is  only  a  function  of  x  (o)  and  Rj  (o)  for 
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a  (i) 


2q 


- 

0 

O 

O  i  1 

0 

O 

O 

O  O 

O 

O 

O 

1 

i  >. _ 

» 

T 


fij  (6) 


(5-29) 


So  S|!^  x  (o)j  can  be  written  in  the  form 

S3[x(°)]  *  xT  (o)  H3  x  (o)  +  R3T(o)K3  R3  (o)  +  xT  (o)  L>3  Rj  (o) 
And  the  process  can  continue  in  the  same  way. 

5-5.  CONCLUSIONS 


(5-30) 


1)  For  an  N  stages  process  the  sequence  of  optimal  input  can  be  written 


in  the  form 


uJfoM  ujN)  x  (0)  +  Ur(N)  Rn  (o) 

U°  (1)«  ujN"1)x(l)  +  UI{N"1)RN_1  (1) 

JN  (N-l)«  Ux(1)x  (N-l)  +  UR^  Rj  (N-l) 


(5-31) 


2)  The  general  expression  for  the  various  matrices  U's  are  too  com¬ 
plicated  to  be  given  explicitely.  However  eqs  (5-31)  show  that  the  value  of  the 
optimal  input  u°  (k)at  the  sampling  instant  k  depends  on  x  (k)  and  on  the  value  of 
the  reference  £  at  all  the  sampling  instants  k,  k  +  1, . .  .N  following  k. 

3)  The  reference  £  must  be  known  a  priori.  This  makes  the  problem 
possible  to  solve  when  it  is  a  regulator  problem;  but  the  dynamic  problem  where 
the  system  is  de sired  to  follow  an  indetermined  reference  input  cannot  be  solved  by 
this  method. 

4)  The  sequence  of  optimal  inputs  can  be  precalculated  and  fed  into  the 
plant.  However  the  expressions  involved  are  very  complicated  and  the  optimization 
became  very  impractical  for  high  order  systems  and  processes  with  a  great  number 
of  stages* 


5)  Clearly  the  conclusions  of  Section  IV  about  the  effects  of  controllability 
and  observability  are  still  valid  here*  for  those  conclusions  are  valid  for  any  type 
of  criterion. 
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R  (1) 


* 

O 

O 

0  |  1  o~ 

2q  . 

O 

O 

d  l 

B 

O 

d 

d !  d  1 

>. _ 

q  T 


£3  (o) 


So  x  (o)j  can  be  written  in  the  form 

S3[x(o)j  *  xT  (o)  H3  x  (6)  +  R3T(o)K3  R3  (o)  +  xT  (6)  L3  Rj  (o) 


And  the  process  can  continue  in  the  same  way. 


(5-29) 


•  (5-30) 


5-5.  CONCLUSIONS 

1)  For  an  N  stages  process  the  sequence  of  optimal  input  can  be  written 
in  the  form 

|J(6)»  u[N>  K  (6)  +  Ur(N)  Rn  (o) 

u£  (1)«  uf~»x  d)  +  U^N"1,Rn_1  (1)  (5-3 

Ujj  (N-l)  *  Ux(1)?c  (N-l)  +  Ujf1*  Rj  (N-l) 


2)  The  general  expression  for  the  various  matrices  U's  are  too  com¬ 
plicated  to  be  given  explicitely.  However  eqs  (5-31)  show  that  the  value  of  the 
optimal  input  u°  (k)at  the  sampling  instant  k  depends  on  x  (k)  and  on  the  value  of 
the  reference  r  at  all  the  sampling  instants  k>  k  +  1*  . . .  N  following  k. 

3)  The  reference  £  must  be  known  a  priori.  This  makes  the  problem 
possible  to  solve  when  it  is  a  regulator  problem;  but  the  dynamic  problem  where 
the  system  is  desired  to  follow  an  indetermined  reference  input  cannot  be  solved  by 
this  method. 

4)  The  sequence  of  optimal  inputs  can  be  precalculated  and  fed  into  the 
plant.  However  the  expressions  involved  are  very  complicated  and  the  optimization 
became  very  impractical  for  high  order  systems  and  processes  with  a  great  number 
Of  stages. 


5)  Clearly  the  conclusions  of  Section  IV  about  the  effects  of  controllability 
and  observability  are  still  valid  heret  for  those  conclusions  are  valid  for  any  type 
of  criterion. 


5.6.  EXAMPLES 
Example  1 

Let  a  second  order  single  input  single  output  system  be  given  by 


fd 

n 

f1 1 

x(N+I)*[0 

•J 

X  (N)  fl, 

u(N) 

(5- 

v  (N)  *  [l 

o] 

n  (N) 

The  system  is  Supposed  initially  relaxed. 

The  eigenvalues  of  matrix  A  are  o  and  - 1  with 


1  i 


6  I 


The  normal  form  representation  is 


O  O 
O  1 


X  (N)  + 


u(N) 


(5-33) 


(5-34) 


v  (N)  *  [l  l]  jj  (N) 


It  is  clear  that  both  coordinates  are  observable  but  only  one  is  controllable. 
The  system  S°  is  defined  by 

y2  (N+  1)=  y2  (N) 

°  (N)  =  y2  (N) 

v°  (N  +  1)  =  v°(N)  »  v0  (o) 


(5-35) 

(5-36) 


to  r. 


If  the  system  is  initially  relaxed  the  new  reference 


-v°  is 


equal 


The  problem  is  now  one  -  d  ime  ns  ional .  The  plant  is  defined  by 

v(N  +  1)=  u  (N) 


(5-37) 


and  tiie  criterion 


In  this  case  the  state  vector  is  identical  to  the  output  v 
One  s  tage  process 

The  results  of  section  (5-2)  show  that 

sl[ v(o)]  *[v  (o)  -  r  (o)j  2  +  u2  (o)  (5-39) 


u  ®  (o)  *  o 

Sj  Jv  (o)  |  *  .[  v  (O)  -  r  (o)  |2 

Two  stage  proc es  s_ 

Sj  for  a  two- stage  process  stands  as 

g 

$2  [v  (o)j*|v  (1)  -  r  (1)  j2  +[v  (o)  -  r  (o)  j  +  u2  (o) 

*  [u  (o)  -  r  (1)  f  +[v  (o)  -  r  (o) ]2  +  u2  (o) 

u£  (o)  is  given  by  the  equation 

u£  (o)  -  r  (1)  +  u®  (o)  «  o 


and  title  minimum  value  of  S^v  (o)j  is 

S2  [v  (o)  ]  =  r  2^  +  [  v  (o)  -  r  (o)]  2 


(5-40) 

(5-41) 


(5-42) 


(5-43) 


(5-44) 


Three  stages  process 

The  egression  to  minimise  is: 
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S3  £v  (o)|*  *  +  [v  (1)  -  r  (*;JZ  +|v  (o)  -  r(  )j  2  +  uZ(o) 


2  ,  2, 


,0.  t[u(.,-r  (l)]2  *,[v(o,-  r(o)]Z  *  «2  W  <»•«' 


u  3  (o)  is  given  by  the  equation 


u|  (o)  -  r  (1)  +  u|  (o)  «  6 


°  t. 

a. 

r  (1) 

u3  'c 

>)  - 

2 

(5-46) 


More  generally,  due  to  the  fact  that  V  (N  +  1)  does  not  depend  on  v  (N)  but  only 
on  U  (N),  for  a  N  stages  process,  tile  sequence  of  optimal  inputs  is  given  by 


u£  (o) 

r  (1) 

2 

u^(i) 

r  (2) 

2 

UN  <2> 

r  (3) 

2 

Ujj  (N  -  2 

)  « 

*  ( N*  1) 
2 

uN  (N  -  1 

V  * 

0 
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Example  2 

Let  a  first  order  single  input  single  output  system  be  given  by 


v  {N  +  1)  -  v  (ft)  a  u  (N  +  1 ) 
If  the  state  vector  is  chosen  as 

x  (N)  -  V  (N)  *  u  (N) 
the  plant  dynamics  are  given  by 

'x  (N+  1)=  x  (N)  +  u  (N) 

i 

v  (N)  =  x  (N)  +  u  (N) 


One  stage  process 

The  expression  to  minimize  is 

Sj[x  (o)]  =  [x  (o)  +  u  (o)  -  r  (o)]2,  +  u2  (o) 
Therefore  (cf  Eq.  5-7) 


u°  (o)  *  r  (o)  -  x  (o) 


(5-48) 


(5-49) 


(5-50) 


(5-51) 


(5-52) 


and 


$i  [x  (o)]  =  j  [  r  (o)  -  x  (o)j 


(5-53) 


Two  stage  process 

The  expression  to  minimize  is 

S,  [x  (o)]=  \  [r  (1)  -  x  (1)  ]  2  +[x  (p)  +  u  (o)  -  r  (o)]  2  +  u2(o) 


(5-54) 


=  i  [r  (1)  -  x  (o)  -  u  (o)]  2  +[x  (o)  +  u  (o)-r  (o)]2  +  u2(o) 
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and  Eq.  (5-13)  gives  the  optimal  inputs 


u|  (o)  -  |  [ 

2  r  (o)  +  r  (1)  ♦  3  x  (o) 

1 

4  <»-4 

r  (l)-x(l)] 

(5-55) 


4 
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SECTION  VI 
CONCLUSION 


This  study  was  concerned  with  multivariable  sampled- data  systems .  it  has 
been  Shown  that  an  optimization  of  Such  a  system  With  a  Squared  error  criterion 
is  generally  possible  and  leads  to  a  sequence  of  optimal  outputs  depending  1)  on 
the  state-vector  at  any  instant  2)  on  the  reference  input  at  sampling  instants .  The 
controller  cannot  work  on  a  real  time  basis;  the  sequence  of  optimal  inputs  can  be 
precalculated  and  fed  directly  into  the  plants  in  the  case  of  a  desired  final  value 
Studied  in  Section  III,  this  precalculation  is  reasonably  Simple •  The  regulator 
type  problem  is  much  more  involved  and  requires  the  knowledge  of  the  reference 
input  before  the  process  starts. 

The  importance  of  controllability  and  observability  of  the  coordinates  of  the 
state  vector  has  been  shown.  In  particular  the  optimization  problem  becomes 
meaningless  when  all  the  coordinates  of  the  system  are  either  controllable  or 
Unobservable,  In  the  general  case  the  number  of  initial  conditions  which  has  to 
be  stated  is  equal  to  the  number  of  observable  coordinates.  The  optimization  can 
always  be  carried  Out  on  a  d*  th  order  system  where  n*  is  the  number  of  observable 
and  controllable  coordinates  of  the  system. 

In  Section  III  the  case  of  an  optimization  with  desired  final  value  has  been  studied 
quite  thoroughly.  The  Sequence  of  optimal  outputs  can  be  derived  using  a  recursion 
formula.  The  regulator-type  problem,  studied  in  Section  IV  leads  to  rather  involved 
results,  and  only  the  form  of  the  results  has  been  given.  In  both  cases  the  Study 
was  limited  to  a  finite  number  of  stages. 


42 


APPENDIX  I 

Partitioning  of  a  multivariable  systems  into  subsystems  according  to  controll¬ 
ability  and  Observability* 

Consider  a  multivariable  n  th  Order  sampled-data*  system  S  given  by  the 

equations* 

£(k+  1)*  Ajr(k)  +  pu(k)  (1-1) 

v  (k)  *  y  Y.  (fc)  +  Du  (k)  (1-2) 

The  order  in  which  the  Components  of  the  State-vector  Can  be  arranged  is 
arbitrary*  Let  us  arrange  them  so  that 


-  The  n*  first  (n*  <  n)  are  both  controllable  and  observable 


Define  jg*  (k) 


“Vi  fc)‘ 

lyn*  <*1 


-  The  nc  following  (nc  <  n)  are  controllable  and  unobservable. 


Define  j£c  (k)  * 


yn*  +  1  0 
_yn*  +  ne< 


-  The  n°  following  (n°<  n)  ere  observable  and  uncontrollable* 


Define  ^ 


yn*  +  nc  +1 


yn*  +  a  +  n  (k) 
~c  o> 


The  n*  following  (n*  <  n)  are  neither  controllable  nor  observable* 


f  ["  y_  +  +  n  °  +  n°  +  1  (k) 
Define  y  (k)  * 


*We  show  here  the  theorem  for  a  sampled-data  system.  It  goes  without  saying  that 
a  similar  theorem  can  be  established  for  continuous  systems. 
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Let  now  the  different  matrices  be  partitioned  in  the  following  way 


I  (k>  = 


jr*  (k) 
XC  (k) 
1  (k) 
1  (k) 


(1-3) 


A  = 


A*  |  Ac 


n*  n  n »  n 


I 


(1-4) 


P  - 


* 

1 

r  i  i  ii 

i  ri* 

ii 

j 

W  |  '  1  > 

- 

S  /r  p  \ 

*  G  i  O  I 

pc _ 

}  nC  (I-5)  V  = 

Y  IV  1  Y  1  V  : 

.6" 

1  6 

1  '  , 

P 

r  a 

1  1  • 

SB-  S  SS  S=i-=M  -=_S 

j 

1  1  1 

„f 

\  f 

1  1 

1  i  I 

P 

} n 

1  1  | 

- 

..  _  .i ,  .  1  i  ^  j 

(1-6) 


*  c  o 

*  n  n  n 


assumption  the  matrices  pc,  y°,  y*  have  all  their  elements  equal  to  zero 


The  system  S  can  now  be  partitioned  into  the  four  following  subsystems ; 
1)  A  subsystem  S*  defined  by  the  equations 


y*  (k+  1)  =  A* 

^  (k)  +  p*  u  (k) 

(UV 

v  *  (k)  =  y*  jr 

(k)  +  D  u  (k) 

(1-8) 

0*  has  no  row  of  zeros  and  y *  has  no  column  of  zeros*  Therefore  the  system 
S*  is  both  controllable  and  observable. 

2)  A  subsystem  Sc  defined  by  the  equations 

%C  (k+  1)  =  Ac  (k)  +  Bc  u  (k)  (1-9) 


vc  <k  +  1)  =  yC2C  (k)  (I- 10) 

G  r  C 

y  has  no  column  of  zeros  but  all  the  rows  of  0  are  zeros.  Therefore  S  is 

controllable  but  unobservable. 
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3)  A  subsystem  S°  defined  by  the  equations 

^°  (  k  +  l)=A°_y°  (k)  +  6°  u  (k) 
v°  (kj  =  y°I°  W 

This  system  is  controllable  but  unobservable.  s  |oj,  v°  (k)  a[°] 

4)  A  subsystem  S*  defined  by  the  equations 

%  £  (k  +  1 )  -  ^  (k)  +  0£  u  (k) 

v£  (k)  =  (k) 

Obviously  S£  is  both  unobservable  and  uncontrollable . 

0  Gif 

The  preeeeding  analysis  shows  that  n*n  +  n  +  n  t  n 

V  (k)=  V*  (k)  +  v  °  (k) 

for 

vc  (k)  <=  v£  (k)  •  0 
u*  (k)  a  uC  (k)  =  u  (k) 


(Ml) 

(1-12) 

(1-13) 

(1-14) 

(1-15) 

(1-16) 

(1-17) 


We  notice  too  that  we  included  the  term  Dj  (N)  in  the  system  S*.  This  is  by 
no  means  necessary.  It  can  be  introduced  with  any  of  the  subsystems,  or  even 
constitute  a  system  by  itself. 
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APPENDIX  II 


Cons ider  the  following  expression 

F  =  (Aju+Xj)7  B|  (Ajy  +  Xj)  +  (Aan  +  x2)T  B2  (A^  +  x2)  +  . . .  +(Anu  +  xr)T  B^fA^+x^) 


Where  u  is  a  p  dimensional  vector 


u  = 


U1  ' 


(II- 1) 


(11-2) 


Xj,  x2,  ...  are  p j,  p2« . * «pft  dimensional  vectors 


xn 

X21 

Xnl 

x12 

x2  = 

x22 

. 

Xn2 

>2 

_x 

Aj  is  a  qj  rows 

Pj  Columns  matrix 

A2is  a  q2  rows 

p  2  columns  matrix 

A  is  a  q  rows 
n  -n  ■ 

p  columns  matrix 

(II- 3) 


Bj  is  a  q^th  order  square  symmetrical  matrix 
B2  is  a  q2th  order  square  symmetrical  matrix 
Bn  is  a  qnth  order  square  symmetrical  matrix 

Assuming  that  the  x's  are  independent  of  u  as  all  the  matrixes  involved  in 
expression  (II- 1 )  the  problem  is  to  determine  the  vector  u  which  minimizes  F . 


Solution 

F  is  a  linear  combination  of  Xj,  x2» .  •  .x^.  The  minimum  of  F  is  obtained  by 
solving  the  set  of  equations. 
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=  6 


=  0 


8F 

P 


(II- 4) 


This  is  a  set  of  p  linear  equations  with  p  unknowns  Uj>  u^»  •  •  ‘^p* 

Now  let  F j  =  (Aj  u  +  B  j  (Aj  u  +  Xj  ) 

Fi  =  JL  bij  (aifc  “k  +  xn> (a  j i  ui  +  x!j)  (II"5) 


i  **  t »  3  •  •  •  CJ  j 

j  a  I>2*..qj 

k  -  1(  2. .  .p 
l  ™  If  2. .  .p 


8Fj  _  v 

Wf  S.ji  bU  ail  (a  jiUl  +  xlj}  b  1  J  1  J1  (aik  "k  +  Xli) 


(II-6) 


Notice  that  we  can  commute  the  indexes  i  and  j  or  k  and  f  in  any  of  the  Yi 


9F1  V 

Iff’ *  fa  (bij  +  V  a  il  {ajk  %  +  xlj> 

and  as  it  is  assumed  by  =  by  (Bj  symmetrical) 

0F, 


(11*1 ) 


is Tsim  *h*u  VV 
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s  imilarly 


8Fj  y 

TR£-=  ai2  bij  <ajkuk  +  Xlj)  = 


(tI-8) 


BFi 


*  2  ^aipbij(ajkufe  +  xij,S5 


This  is  equivalent  to  the  matrix  equation 


A1T[B1  ai^+5i]  =  ° 


(II- 9) 


Coming  back  to  the  former  expression  of  F  it  is  clear  that  the  solution  of  our 
problem  is  given  by  the  equation 

V  B1  [Aj  u  +  Xj]  +  A2T  B2[A2  u  +  x2]  +...+ AnT  Bn  [  Aft  u  +  xn  ]  =  o  (II- 10) 
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APPENDIX  III 


Appendix  II  gives  the  solution  Of  the  problem  of  minimizing  with  respect 
to  u  an  expression 


F  » 


n 

Zi(Aku+xk)TBk(Aku  +  »k) 


(iii-l) 


This  Appendix  is  concerned  with  a  similar  problem  but  the  expression  to 
minimize,  instead  of  being  as  indicated  in  Eq.  (Ill-  1)  has  the  form 

m 

*•'  *  F  +  2  (A.U  +  X.)1’ 

k=l  -K 


Bk  £k 


Where  A^  u  +  is  a  pk  dimensional  vector 


vk  is  a  rk  dimensional  vector 


is  a  p^  rows  rk  columns  matrix 


Solution 


n 


t,CtP"  (Ak“+^k)T  Bk^k 

The  minimum  of  F*  is  obtained  by  solving  the  set  of  equations 


*2) 


■3) 


8F*  .  8F 

.  8Fm  _ 

8  Uj  8ul 

*  dUj  ° 

8F»  _  8F  _j 

u  8F»*  *  o 

8u2  *"2 
• 

8u2 

e 

8F'  8F 

~BvT~ 

n  n 

,  8F*  ■ 

+  -5u“b  ° 

*  u 

Let  Fn  j  *  (Aj  u  +  Xj)^  B j  Vi 
F  n  j  can  be  written  as 

F"l“  £  + 

i  -  1*  2,  •  •  .p j 

j  “  1,  2,  . . .  r  j 


(m-4) 


(ni-5) 


(m-6) 
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The  set  of  partial  derivatives  of  F"  j  with  respect  of  Uj,  u^,  •  •  •  u_  is  given  as 


0  F"  j  , 

“Hp  §  by  *n  yu 


0F",  v  (IH-7) 

*u*i*vu 


8  Fn  = 

VainVlj 


Letting  all  these  partial  derivatives  to  zero  is  equivalent  to  Solving  the  matrix 


equation 


B, 


V1 


*  o 


(in-8) 


Coming  back  to  the  expression  of  F*  as  given  in  (HI-2)  and  taking  into 
account  the  result  given  in  (n- 10),  the  u  which  solves  our  problem  is  given  by 
the  equation 


n 

m 

+  Z  ATt  B.  v.  ■  o 
k*l  - 

(m-9) 
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